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A VIDEO SIGNAL COMPENSATOR FOR COMPENSATING 
y\ DIFFERENTIAL PICTURE BRIGHTNESS OF AN OPTICAL 

IMAGE DUE TO UNEVEN ILLUMINATION AND METHOD 
ABSTRACT OF THE DISCLOSURE 
A video signal compensator and method for compensating for 
differential picture brightness of an optical image due to uneven 
illumination is shown. The video signal compensator includes a 
device for generating a compensating signal substantially 

e 

*0 representing at least one parameter of a compensating waveform 
UJ 

jj3 required to produce a video signal representing an optical image 

having a substantially uniform brightness. An adder operatively 

= coupled to the compensating signal generating device and a video 
O 

|3 signal adds the compensating signal and the video signal to 

i'U 



produce a compensating video signal used as an input to a video 
signal processor adjusting its gain both vertically and 
horizontally compensated by increasing the gain of the video 
signal representing that part of the optical image which is less 
bright than a reference and reducing the gain of the video signal 
representing that part of the optical image which is brighter 
than a reference compensating the video signal to represent an 
optical image having a substantially uniform brightness. The 
compensating signal can be generated by either an analog signal 
generating device or a digital signal processing device. 



***** 
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A VIDEO SIGNAL COMPENSATOR FOR COMPENSATING 
DIFFERENTIAL PICTURE BRIGHTNESS OF AN OPTICAL 
IMAGE DUE TO UNEVEN ILLUMINATION AND METHOD 
BACKGROUND OF THE INVENTION 
1. Field of the Invention 

This invention relates to a video signal compensator for 
compensating a video signal for differential picture brightness 
of an optical image and more particularly relates to a video 
y signal compensator for compensating a video signal for 

m 

j= differential picture brightness of an optical image due to uneven 

s 

fy illumination. In the preferred embodiment, the video signal 

01 

^ compensator compensates for differential picture brightness of an 

U 

~ optical image from an endoscope which is brighter at its center 

i w 
m 

-q than at its periphery. The optical image from the endoscope is 
imaged onto a video sensor. 
2. Description of the Prior Art 

A wide variety of optical instruments are used to generate 
optical images. In the medical field, endoscopes are used in 
performing surgical procedures, such as minimally invasive 
surgery, to generate optical images from within a body cavity. 

In the industrial field, borescopes are used to inspect 
interior spaces, such as the interior stage of a jet engine, 
which are generally inaccessible. Other optical instruments are 
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used for performing such routine tasks as inspecting interiors of 
sewer lines, ventilation systems, pipe lines and other elongated 
cavities . 

Typically, such optical instruments have a video camera 
operatively coupled to the proximal end thereof to receive the 
optical image and to produce an video signal of the optical 
image. The video signal is typically processed by a video signal 
processor - and displayed on a v i deo moniteoi * o» stored by a video 

□ 

*Q storage device. 
U 

J; It is also known in the art that a video sensor may be 

i . 

ry integral with the proximal end of an optical instrument. The 

m 

= output of the video sensor in such an instrument is typically 

D 

M applied to a video signal processor which processes the video 

B . > 

J," signal to produce a video output signal which is applied to a 



video monitor. One example of such an instrument is a Video 
Operating Laparoscope offered for sale and sold by CIRCON ACMI 
Division of Circon Corporation, the assignee of the present 
invention. 

It is also well known in the art that body cavities, hidden 
or inaccessible spaces and elongated cavities are either dark or 
have such low light levels that it is difficult for optical 
instruments to produce an optical image that can be 
satisfactorily imaged by a video camera or video sensor. 

In order to overcome these problems, a wide variety of light 
sources have been developed to produce light energy at light 
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levels that provide sufficiently high light levels of 
illumination in the body cavities, hidden or inaccessible spaces 
and elongated cavities. A sufficiently high light level enables 
the optical instruments to produce an optical image of the 
operative site and to transmit the optical image to the proximal 
end of the optical instrument enabling the optical image to be 
imaged by the video camera or video sensor. 
_ In order to accomplish the above, the optical instruments 

^ typically include a light guide, such as for example a fiber 

5 

^ optic light guide, to transmit light energy from a light source 

h 

PJ through the proximal end of and through the instrument to the 

m 

distal end thereof. The light energy is used to illuminate the 

P 
ft- 

~ operative site or area subject to inspection. The optical image 

m . 

is then transmitted by an optical image transferring system from 
the distal end of and through the instrument to the proximal end 
thereof where the optical image is directed on the video camera 
or video sensor. 

It is also known in the art that the endoscope may have an 
illumination source located at the distal end of the endoscope. 
One of the known prior art laparoscopes had a light bulb located 
at the distal end of the laparoscope wherein electrical 
conductors extending from the distal end to the proximal end of 
the laparoscope energized the light bulb to illuminate the 
operative site or area subject to inspection. Illumination from 
the light bulb located at the distal end of the endoscope 
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produced uneven illumination due to the characteristics of the 
light energy emanating from the. light bulb. 

It is also known in the art to locate a video sensor, such 
as a CCD chip, on the distal end of a optical instrument. Such a 
structure eliminates the use of a optical image transferring 
system or member. However, such optical instruments still 
require a light guide to transmit light energy from a light 
source to the distal end thereof to illuminate the ^^rcrtrStg site 



□ 

-j or area subject to inspection. Electrical conductors located 

m . . 

g within the optical instrument transmit the video signal from the 
fU distal tip of and through the instrument to a video signal 
3 gompencator ■ 

jfj It has been observed that when an optical instrument is used 

ifi in combination with a light guide, or distally located 

illumination source, the resulting optical image from the optical 
instrument has differential picture brightness due to uneven 
illumination at the distal end thereof. . 
^ For example^ a typical medical endoscope, having a fiber 

optic light guide, have diameters generally in the order of about 
5 mm to about 10 mm or larger at the distal end. Such endoscopes 
generally produce an optical image that is brighter in the center 
and dim on the periphery or edge. In smaller diameter endoscopes 
having a fiber optical light guide, for example endoscopes having 
a diameter at the distal end of less that 5 mm, the optical image 
^ may be saturated at the center^ 
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One known design approach to solve the differential picture 
brightness problem is to modify. the structure and characteristics 
of the light guide, the optical image transferring system or 
member or modify both in an attempt to obtain a more uniform 



instrument itself. 

The fiber optic light guides and optics of the optical image 
transferring systems have been optimized, but, however, the 
differential picture brightness problem still persists. 

The primary cause for the differential picture brightness 
problem has now been identified to be other than the optical 
instrument. It has now been identified that it is the light 
source itself which generates a light energy or light radiation 
having a peaked characteristic curve with a bright spot in the 
center thereof and a dim periphery or edge. When the light 
source is operatively coupled to the light guide, e.g. the fiber 
optic light guide in an endoscope, the transmitted light energy 
retains the characteristics of the light source; namely, a bright 
spot in the center thereof and a dim periphery or edge. In 
essence, each optical instrument reproduces the characteristic 
curve of the light source and this results in an optical image 
having a differential picture brightness due to uneven or non- 
uniform illumination. 



brightnes 




image developed by the optical 
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Unsuccessful attempts have been made to design or modify the 
light source to reduce or eliminate the above described 
deficiencies . 

In addition to the above and as is well known in the art, 
variations in the operating characteristics of the video sensor 
or video camera generating the video signals representing optical 
images introduce shading into the video signal. The combination 
of the light source problems and shading problems have resulted 

P 

y m poor quality optical images which, in turn, produce poor 

m 

J; quality electronic optical images. 

It is known in the prior art that vidicon tube cameras, such 

En 

!L as for example, a Sony video tube cameras, have used a shading 
Hj circuit to compensate for the variations in the operating 

m 

yj characteristics of the vidicon tube itself (the tt Sony Vidicon 
Shading Circuit") . The Sony Vidicon Shading Circuit used a 
parabolic waveform and a sawtooth waveform to generate a 
compensating signal which adjusts the video signal as required to 
overcome the variations of the vidicon tube operating 
characteristics. 

United States Patent 5,343,302 vliailu&ea a video camera 
which includes a correction circuit in which a parabolic wave 
signal is generated and the level thereof is adjusted in 
accordance with the zoom and iris settings of the camera's 
optical system. After adjustment, the parabolic wave signal is 
clipped in accordance with a reference level and the clipped 
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parabolic wave signal is used for correcting the shading of the 
camera's image signal. The clipping of the parabolic correction 
signal allows for a more accurate shading correction. The 
shading correction circuit performs the shading corrections 
principally in the case of the reduction of the light intensity 
ratio from the periphery to the center of the image caused by 
aperture eclipse and in the case of f-drop (i.e. reduction of the 
f -number) at the telephoto lens setting. 
jlV United States Patent 5,157,497 dioclooog — a method and 

^ apparatus for detecting and compensating for white shading errors 

s . 

ry m a digitized video signal using a flat white calibration 
target . rtfcm 't^ J ^M lb capable of automatically 

□ 

K determining the amount of white shading correction to be applied 

ru 



m 

XI 



to specific video image pixels as well as the application of that 
correction to a digitized video signal. The system includes an 
inspecting portion for identifying the r e q uir e d correction w ithi n 
a irjfi o o frame, d calcu l ating portion for computin g the amount o f 
■ rnrrftrft i on fn h e applied Lu Lh e videu blyudiL, aud a coircetion 

Portion for QgiWi - i^f i nq fhn virion rirjnnl hi^ IIPP ^ ro^^ j ^ n 

. computod by th\i ualoulating puiLiun . 

United States Patent 5,053,879 ^ didolooco a method and device 
for shading correction used in a video printer comprising a TV 
camera for providing image data of a subject to be printed and an 
exposure CRT for displaying the image data thereon and to which 
photographic paper is exposed to make a video printout of the 
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subject. In carrying out the shading correction method, the 
shading correction, device employs a memory for storing the 
shading correction data, a frame memory for storing image date of 
a subject to be printed and a device for adding the shading 
correction data read out from the memory and the image data 
readout from the memory. 

United States ^Patonto 1,070, BOO a r ^y 1, 970, 042 ' disclose 
apparatus for correcting shading effects in video images for a 

S 

*3 document retrieval system. The document retrieval system 

W 

S3 

captures an image of a document in electronic form usinq linear 
fy CCD imagers or a CCD array. The apparatus reduces the size of 

m 

£ the memory required to store • correction information by defining 
□ 

23 the two dimensional non -uniformity characteristics in terms of 

ru 

^ two functions that are orthogonal. The orthogonal correction 

w 

*3 

functions are stored in separate memories. During a scan, a 
pixel counter addresses the X memory while a line counter 
addresses a Y memory. The correction factors thus obtained are 
applied sequentially to correct the pixel data value at the 
current X and Y coordinates. The sources of non-uniformity which 
are corrected by the apparatus include use of the lens having 
non-uniformities which are generally known in the optical art as 
the "cos" law (sometimes known as the cosine law) to focus the 
image onto the capturing device and, the CCD pixel sensitivity 
variations and spot uniformities that may occur in an 
illumination source such as a lamp filament. 
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^ - Th e above, doccr ib od prion ait myidbeuL the Lypiial * 

^ ■ 1 ■ '>' "i l M jiAiMmii ■ " 1 iii * l1>i i -thn rt ing in 

£/ opt i m l imnjr fn r a variety o f vidoo ima g in g apparatus and 

syst e m. 

SUMMARY OF THE INVENTION 
A novel, new and unique compensating apparatus or video 
signal compensator for compensating differential picture 
brightness of an optical image due to uneven illumination is 

□ 

disclosed and taught by this invention. The compensating 

S3 

^ apparatus or video signal compensator includes a device for 

S 

nj generating a compensating signal substantially representing at 

m 

= least one parameter of a compensating waveform required for the 

5 

S3 differential picture brightness of an optical image to produce a 

iU 

video signal representing an optical image having a substantially 

=y 

uniform brightness. An adder is operatively coupled to the 
compensating video signal generating device and a video signal 
for adding the compensating signal and the video signal to 
q^/ produce a ^p pnfia f i ng «-ig^ai hmh as an input to a video signal 
processor adjusting its gain both vertically and horizontally by 
increasing the gain of the video signal representing that part of 
the optical image which is less bright than a reference and 
reducing the gain of the video signal representing that part of 
the optical image which is brighter than a reference. The 
compensated video signal represents an image having a 
substantially uniform brightness. 
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In addition, a new novel and unique method for compensating 
for differential picture brightness of an optical image due to 
uneven illumination is discloses and taught by this invention. 
The method comprises the steps of: (a) generating with a 
compensating signal device a compensating signal substantially 
representing at least one parameter of a compensating waveform 
required for the differential picture brightness of an optical 
image to produce a video signal representing an optical image 

□ 

& having a substantially uniform brightness; and (b) adding with an 
U 

03 

*2 adder operatively coupled to the compensating signal generating 
4- 

n\ device and a video signal the compensating signal and the video 
S 

s signal to produce a compensating video signal used as an input to 
G 

33 a video signal processor adjusting its gain both vertically and 

> 

horizontally compensated by inc: 



•J! horizontally compensated by increasing the gain of the video 



signal representing that part of the optical image which is less 
bright than a reference and reducing the gain of the video signal 
representing that part of the optical image which is brighter 
than a reference compensating the video signal to represent an 
optical image having a substantially uniform brightness. 

In the preferred embodiment of the apparatus and method of 
the present invention, the differential picture brightness of an 
optical image is brighter at its center than at its periphery or 
edges. Thus, the compensating video signal is used to adjust the 
gain of the video signal processor both vertically and 
horizontally by increasing the gain of the video signal in 
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circuit therein disclose, suggest or teach compensating for 
differential picture brightness of an optical image from an 
optical instrument imaged onto video camera or sensor. 

The method and apparatus of United States Patent 5,157,497 
detects and compensates for white shading errors in a digitized 
video signal using a flat white calibration target. The method 
and apparatus of United States Patent 5,157,4 97 was based on use 
of a flat white calibration target and was not used to correct 

□ 

^ for differential picture brightness of an optical image from an 

UJ 

optical instrument imaged onto video camera or sensor. 

=?° 

ry The shading correction device disclosed in United States 

m 

s Patent 5,053,879 is used for a video printer and employs a memory 
O 

53 for storing the shading correction data, a frame memory for 

"y 
m 

=Lj storing image date of a subject to be printed and a device for 
adding the shading correction data read out from the memory and 
the image data readout from the memory. The shading correction 
device of United States Patent 5,053,879 is based on adding 
shading correction data read out from the memory with the image 
data readout from the memory. United States Patent 5,053,879 
does not disclose, teach or suggest correcting for differential 
picture brightness of an optical image having uneven illumination 
from an optical instrument imaged onto video camera or sensor. 

The apparatus and method disclosed in United States [Patents 
4,979,598 and* 4 , 979 , 042 disclose and teach correction of shading 
effects in video images for a document retrieval system. The 
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document retrieval system capture an image of a document in 
electronic form using linear CCD imagers or a CCD array. The 
apparatus defines the two dimensional non -uniformity 
characteristics in terms of two functions that are orthogonal 
about orthogonal axes. The sources of non-uniformity which are 
corrected by the apparatus compensate for lens deficiencies, the 
CCD pixel sensitivity variations and spot non-uniformities that 
may occur in an illumination source such as a lamp filament. The 

□ 

r tj^ apparatus and method disclosed in United States (patents 4,979,598 

S3 c 

^ and "4 , 979, 042 do not teach, disclose or suggest compensating 

*D 

fy differential picture brightness of an optical image due to uneven 

- illumination from an endoscope imaged onto a video camera. 

O 

^ The prior art does not disclose, teach or suggest 

J compensating video images for the non-uniform characteristics of 
a light source located at or transmitted by a light guide to the 
distal end of an optical instrument to illuminate an operative 
site or inspection area. 

The apparatus and method of the present invention overcomes 
several of the problems of the prior art including compensating 
for differential picture brightness due primarily to the non- 
fyS uniform characteristics of a light source ^ocafpfi ar — 



operatively coupled to a light guide for illumination of an 
operative site or inspection area. The light energy is typically 
reflected from the surface of the operative site or inspection 
area. The reflected light energy and optical image developed 
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P 
■3 
U. 

m 
m 



25 

Hi 



therefrom in an optical instrument include the non-unif ormiti 
or unevenness of the light energy. 

One advantage of the present invention is that the 
compensation correction apparatus and method can be used for 



tt\t4tujP 

optical images developed form a variety of optical instruments 



sensor or video camera. 

Another advantage of the present invention is that the 
amount and shape required for compensation correction can be 
adjusted as required or an approximation thereof can be provided 
with adjustable wave shaping devices or circuits. 

Another advantage of the present invention is that optical 
instruments developing an optical image having differential 
picture illumination with an uneven light return path and light 
and dark areas which are imaged onto a video sensor or video 
camera can have the so produced optical images compensated 
electronically such that the brightness of the areas is more 
uniform or flat. 

Another advantage of the present invention is that a 
sampling circuit or sensing circuit may be used to determine the 
correction required for appropriate compensation or an 
approximation thereof and such circuits can be used with 
adjustable wave shaping devices or circuits. 

Another advantage of the present invention is that a the 
light returned from the cosine angle of the reflecting surface 




having 
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can be sampled or sensed and a correction based thereon can be 
developed and applied to video ..amplifiers to reduce the gain in 
the bright areas and increase the gain in the dark areas to 
produce a video signal representing an optical image having 
substantially even field illumination. 

Another advantage of the present invention is that the 
compensating signal required for making the corrections and the 
means for applying the compensating signal may be analog, digital 

B 

|S or other means, e.g., a hybrid of analog and digital. 
K 

^ Another advantage of the present invention is that a video 

* • i 

(U signal compensator can produce corrections wherein the 

m 

a differential picture brightness of an optical image is brighter 

0 

jjj* at its center than at its periphery or edges. The video signal 

£n 

^ compensator includes an adder which adds a sawtooth waveform, a 

S 

parabolic waveform and a video signal to produce a compensating 
signal used as an input to video signal processor adjusting a its 
gain both vertically and horizontally by increasing the gain of 
the video signal in response the sawtooth waveform representing 
the periphery of the optical image and reducing the gain of the 
video signal in response to the parabolic waveform representing 
the center of the optical image compensating the video signal to 
represent an optical image having a substantially flat 
brightness . 

Another advantage of the present invention is that a video 
signal compensator can produce corrections wherein the 
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differential picture brightness of an optical image is brighter 
at its periphery or edges than at its center. The video signal 
compensator includes an adder which adds a sawtooth waveform, a 
parabolic waveform and a video signal to produce a video 
compensating signal used as an input to a video signal processor 
adjusting its gain both vertically and horizontally by decreasing 
the gain of the video signal in response the sawtooth waveform 
representing the periphery of the optical image and increasing 

□ 

*g the gain of the video signal in response to the parabolic 
W 

63 waveform representing the center of the optical image 
■P 

m compensating the video signal to represent an optical image 

5 

= having a substantially flat brightness. 
□ 

03 Another advantage of the present invention is that a video 

ru 

*2 signal compensator can include a control device operatively 

-41 
.ft 

v coupled to an adder to increase the brightness of the output 

video signal- to a level which is greater than the average of the 
differential brightness of the optical image due to the uneven 
illumination. 

Another advantage of the present invention is that a video 
signal compensator can be used for compensating differential 
picture brightness of an optical image due to uneven illumination 
from an endoscope imaged onto a video sensor or video camera. 

Another advantage of the present invention is that a method 
for compensating for differential picture brightness of an 
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optical image due to uneven illumination using a video signal 
compensator is shown. 

Another advantage of the present invention is that a method 
for compensating for an uneven light path in an endoscope or 
other optical instrument is shown. The method for compensating 
can be used to compensate for non-uniformities of the optical 
system alone or in combination with an illumination system having 
non-uniformities as used in television viewing systems. 
*3 BRIEF DESCRIPTION OF THE DRAWINGS 

u 

*2 The foregoing and other advantages of this invention will be 

yp 

apparent from the following description of the preferred 

m 

= embodiment of the invention when considered with the 

□ 

illustrations and accompanying drawings which include the 

ru 

following Figures: 
- Fig. 1 is a front, top and left end perspective view of a 

endoscope in the form of a laparoscope having a video camera 
operatively coupled to an eyepiece located at the proximal end 
thereof for practicing this invention; 

Fig. 2 is a partial top plan sectional view showing the 
proximal end of another embodiment of a laparoscope having a 
video sensor directly operatively attached thereto for practicing 
this invention; 

Fig. 3 is a distal section perspective view of on embodiment 
of a laparoscope of Fig. l showing the distal tip having a 
transparent member for passing an optical image, the location of 
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the fiber optic light guide around the periphery of the 
laparoscope and two nozzles for directing fluid across the 
exterior surface of the transparent member; 

Fig. 4 is a distal end elevational view showing another 
embodiment of a laparoscope having a single nozzle for directing 
fluid across the exterior surface of the transparent member and 
the location of the fiber optic light guide around the periphery 
of the laparoscope and nozzle; 

□ 

& Fig. 5 is a distal end elevational view of yet another 

UJ 

|p embodiment of Fig. 4 showing an additional working channel and 
pj orientation of the fiber optic light guide; 

m 

£ Fig. 6- is a distal end elevational view of yet another 

□ 

embodiment of Fig. 5 having a fourth channel and orientation of 
the fiber optic light guide; ) 
**. Fig. 7 is a distal end elevational view of yet another 

embodiment of a laparoscope having a nozzle, an irrigation flow 
orifice, which could be utilized as a first working channel, and 
an accessory or working channel which is larger that the first 
channel and which is adapted to pass working accessories and 
orientation of the fiber optic light guide; 
ff^S Fig. 8 is block diagram of an analog video camera having 

video signal compensator located between a preamplifier and video 
signal processor; 

Fig. 9 is a block diagram of a digital video camera having a 
preamplifier, digital-to-analog converter, digital signal 



m 
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■ p y oooooingv analog- to-digital converter wt t^-tho video signal 
processor located after the analog-tordigital converters- 
Fig. 10 is a block diagram of another embodiment of a 
digital video camera having a preamplifier, video signal 
compensator, digital-to-analog converter, digital signal 
processor, analog-to-digital converter and a m o nitor illustrating 
that the video signal processor is located before the analog- to- 
digital converter; 

Fig. 11 is a block diagram of another embodiment of a analog 

_p video camera having a video sensor, preamplifier, analog video 

^ , an adp4~dwhj*n4 

(LflJ signal processor, video signal compensator and monllui/ 

qj^ illustrating that the video signal yro E ooooc^ is located after the 

P 

O analog video signal processor; 

g a» g » 12(a) a n d Fig. 12 (hb aropreoaii fc graphs showing: (i) the 
brightness of the optical image represented by a video signal 
having a differential picture brightness where the center is 
brighter than a reference level and the periphery is less bright 
than a reference level; and (ii) the brightness of the optical 
image represented by a video signal after adjustment by the video 
signal processor in response to a compensating signal which has 
been added to the video signal compensating the video signal to ' 
represent the optical image having a substantially uniform 
brightness, respectively; 

$S Jigi 13(a) and Fig. 13(b) are pictorial representations of^ J 

(i) an optical image wherein the center is brighter than a 
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reference level and the periphery is less bright than a reference 

0^ level and of an optical image wherein the center is less bright 

^ than a reference level; and T^i^ the periphery is brighter than a 

reference level, lespfctCLi vely , 

Fig. 14 is a pictorial representation of a compensated video 

signal of an optical image having a substantially uniform 

brightness; % 

0^/ Figs. 15(a), 15(b) and 15(c) are wavefovmy of a sawtooth 
p 

*S wave generator having an increasing slope, a waveform of a 

y 

33 sawtooth wave generator having an decreasing slope and a waveform 



of a parabolic wave generator having controlled amplitude and 



orientation, ■ roopootively; - 

□ 

u5 Fig. 16 is a schematic diagram of the preferred embodiment 

n ! 

■ w 

of a video signal compensator of the present invention adapted to 

=y 

■ f\ 

fe be located in a video camera at a location illustrated in Fig. 8; 

Fig. 17 is a block diagram of a digital video camera having 
a digital storage device for storing a digital representation of 



the video signal having tiff di£f eieuLial brightness due to uneven 



:ion oroGo OGOtionat * and a digital sic 



illumination oroco OGOtionat * and a digital signal processor for 
generating a digital compensating signal which is converted by a 
digital-to-analog converter to an analog signal before being 
applied to an adder to produce a compensated analog video output 
signal from the -^ijitnl Tignrhl prnron -vtT; and 

Fig. 18 is a block diagram of a digital video camera having 
£ different embodiment of a video signal compensator having d 
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digital storage device for storing a digital representation of 

fautM^ haying 

the video signal " havin g the differential brightness due to uneven 
illumination cross -sectional and a programmable digital processor 
having an 8 x 8 pixel multiplexer/processor for producing a 
compensated analog video output signal; 

Fig. 19 is a waveform of a video signal from a small 
diameter endoscope illustrating the noise before and after the 
video signal representing the picture information; 

Fig. 20 is a waveform of -tire video signal from a small 



m 



diameter endoscope illustrating the action of a sensing device 
for sensing and removing the noise before and after the video 
signal representing the picture information; and 



8} Fig. 21 is a block diagram of a sensing device for sensing 

and removing the noise tohiulr, in the preferred embodiment, is in 



*0 



the form of a blanking circuit . % ~ 

^BreR I &TIOWQr TUB PRE F ERRED '" EMBODIMENT 
Before commencing with the detailed description of the 
preferred and other embodiments of the present invention, the 
following review will provide a better understanding of the 
application and utility of the present invention to optical 
instruments or optical devices which are used to produce an 
optical image directed onto or imaged onto a video sensor or 
camera^ 
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Video cameras used with optical instruments for medical and 
industrial applications generally . are known as an "analog video 
camera", a "digital video camera" or a "digitally controlled 
video camera" . 

In an analog video camera, the video sensor is typically 
separated from a video signal processor which is sometimes 
IK referred to as the video camera. The output of a - COD 1 is an 

analog signal which is applied to a preamplifier. The output of 

□ 

gthe preamplifier is operatively connected to a remotely disposed 
S video signal processor either directly by electrical conductors 
(^^jor indirectly by a wireless device such as^infrared transmitter 
g and receiver. The output of the video signal processor is an 

q 

^analog video signal in a preselected format, e.g., NTSC, Y/C, RGB 
r-s yj^or other Format.)' All signal transmission and processing is 

^.accomplished using analog techniques. 

In a digital video camera, the video sensor is again 
typically separated from the video signal processor. The output 
of a CCD is an analog signal which is applied to a preamplifier. 
The output of the preamplifier is operatively connected by ^( 
analog-to-digital converter to a remotely disposed digital signal 
processor. The output of the digital signal processor is applied 
to a digital-to-analog converter wherein the output thereof is an 
analog video signal in a preselected format, e.g., NTSC, Y/C, RGB 
or other ^ovmS^ It is also envisioned that the preselected 
format, encoding scheme or standard television system encoding 
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format could be the PAL format, SECAM format or any other format 
utilized in a country as a standard of that country. In 
addition, the format could be a proprietary format for use in a 
OLs- closed circuit television system. The use of^ the term "NTSC, 
Y/C, RGB or other Format" is intended to all cover of such 
preselected formats of output video signals. 

In a digitally controlled video camera, the video sensor 
preamplifier and remotely disposed video signal processor are 

□ 

*0 substantially operationally the same as the analoq video camera 
U 

However, a digital system controls the operation of each of the 

components and controls transfer of signals between components, 

all under control of a digitally programmed devices. However, 
□ 

S3 the output of the video camera is an analog video signal in a 
preselected format, e.g., NTSC, Y/C, RGB or other^©5^^T 

1L/ Tho video cignal compensator , » apparatus and method of the 

present invention can be used with any of the above described 
video cameras. The term "video sensor" as used herein is 
intended to collectively and broadly refer to a video sensor, 
line sensor, solid state sensors, area sensors, CAD, vidicon 
0<y tubes, CCD sensors or other video ooncorc used in practicing this 
invention including sensors located at the proximal end of the 
optical instrument, such as an endoscope. Also, the term "video 
sensor" is intended to cover all such sensors located at a 
different location in the optical instrument, such as *x \ i a ' CC D* 
sensor located^the distal tip of an endoscope, or to a vidcfe 
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0^ camerayyoperatively attached to tm optical- i nctrtttn a nt ', -ondoGcopc 

or other optical device wherein an optical image developed by the 
(h^ o ptical iiibLiumeni 1 or optical device, having an illumination 

provided from a light source or a light guide, is imaged onto a 
0*-~ LL1 > " c a ncor or video lamaia. 1 

Referring now to Fig. 1, Fig. 1 illustrates the preferred 
application for using the teachings of the present invention in 
an endoscope. Fig. 1 illustrates an instrument, generally as 30, 

□ 

v9 which is an endoscope in the form of a laparoscope for medical 
~ surgery. The instrument 3 0 includes a l ' ig i d A l ong a to d oneatb 
« fcubc 32 * having a selected length and a distal section or end 3 6 

m 

s and a proximal section or end 38. The distal end 36 terminates 
□ 

S3 in a distal tip shown generally as 44. The interior of the 
^^Laparoscope includes an optical image transferring weans , system 
TL-^or member, t y p icttll -y k lens system including relay lenses , for 
(^/transferring an optical image from the distal tip 44 the 
iHbdge^ 4ilcngaLt!U. choafeh tube 32 ' to the proximal end 38 of the 
laparoscope 

The proximal end 38 of the laparoscope is operatively 
connected to an extension member shown generally as 48. The 
fiLs- extension member 48 includes ■ moano for cupport ; inr> a light post 52 



Q^/ an< ^ ^uafia £oi n d o fining * openings or ports for two channels, which 

openings are shown as 54 and 60 (60 being visible in Fig. 2) . 
0^/ Valve qnca w s, which in the preferred embodiment are trumpet valves 
58 and 62, are operatively connected to openings 54 and 60 
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respectively. An eyepiece housing, shown generally as 64, 
terminates in an eyepiece 66 which permits a surgeon to view the 
optical image transferred through the laparoscope. However, in 
Fig. l, a video sensor, typically a CCD sensor and preamplifier, 
shown generally as 68, is operatively connected to the eyepiece 
to convert the optical image into a video signal. The video 



signal is ultimately processed by a video signal g 2r oeg gff jmg 

fc/ ^oxia n for PY^mplc l»r in F i g — (-84*, to produce a video image on a 
□ 

■U monitor or video signals for storage of the video image on 

ffl magnetic tape or other storage ^noano ? ■ (T r 1 0 . { f a ff vu - 

■P 

^ The laparoscope 30 may include a plurality of channels which 

tn 

_ can be used for a number of functions. Several species or 

r"*i 

SQ embodiments of laparoscopes are disclosed herein in Figs. 1 

fU 

Qj through 7 to show that the present invention can be used with a 

4J 

wide variety of endoscopes or optical instruments. 

Fig. 2 shows the proximal end of another embodiment of a 
laparoscope 30 having a video sensor housing, shown generally as 
64', which is adapted to have a video sensor 68' directly 
operatively attached thereto for practicing this invention. In 
addition, Fig. 2 illustrates pictorially that a light source 67 
is operatively coupled to the light post 52. The light post 52 
$S is operatively connected to a fiber optic light guide f?h~vn ac 72 
in Fig. 4. The fiber optic light guide transmits the light 
energy from the light post 52 located at the proximal end 3 8 of 
the laparoscope 30, through t-*» J£tift&!Li irhmnrh mbc 3D to 
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the distal section or end 36. The light energy is then is 
directed onto the operative site or inspection area to illuminate 
the same 

Typically the light sources are metal halide, xenon light 
sources or other similar devices. The light energy from the 
light source 67 is in the form of a light beam or radiation beam 
that has defined spatial distribution characteristics which 
generally includes that center thereof has higher brightness than 

Q 

\Q the periphery or edges thereof. The light energy is applied to 
Ui 

*2 the fiber optic light guide, or light guide in other optical 
^ instruments, through a light post or equivalent device such as a 
coupling lens or cone system. 

o ^ 

OS The fiber optic light guide, as well as the other light 

fu 

guides, transmits the light energy and retains the defined 
spatial distribution characteristics of the light energy. The 
light energy is directed onto the operative site or inspection 
area to illuminate the same. The reflected light returned from 
the cosine angle of the reflecting surface is transmitted by the 
optical image transferring system to the proximal end of the 
optical instrument 3 0 where the optical image having the 
differential picture brightness developed by the spatial 
distribution characteristics of the light energy, is imaged on 
the video sensor 68' . In the alternative, the optical image can 
be sampled or sensed, using digital sampling and measuring 
techniques which are well known in the art, and a correction or 



0 
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compensating signal based thereon can be developed and applied to 

and 



video amplifiers to reduce the gain in the bright areas 
increase the gain in the dark areas to produce a video signal 
representing an optical image having substantially even field 
illumination . 

In Fig. 2, the fiber optic light guide used for illumination 
of the operative site or inspection area can be varied in 
structure as illustrated in the embodiments of Figs, 4 through 7 

□ 

^ as described herein below^ However, the non-uniform 

characteristics of a light source 67 yd* are transmitted through 
the light guide in the optical instrument to the distal end -and- 
^Humiliate a - the operative site or inspection area which produces 

□ 

Ul the optical image having a differential picture brightness due to 
fU 

S] uneven illumination. 

^ Fig. 3 shows another embodiment of a distal end of a 

laparoscope utilizing the teachings of the present invention. In 

III tlA 1 1~ k 

the embodiment of Fig. 3, the distal tip 44 includes ^I^Mwhich 



> Timn aft 



<JO are located within the ri gi d rtlongatod ohcafch Uibe 32 f or 
0^ defining at the distal end 36 a -means for directing a fluid flow 
CO across the exterior surface of an image passing - sioanc shown 

^ grnnral i» y as 76. Image passing Jn e anp . 76 including the distal end 

... 0\ Vf\<jr#^cv__ 

of the optical image transferring system of member is located in 

& tn e center of an aperture 74. In Fig. 3, the image passing moans 

^ may be a distal lens, a window or transparent surf ace "f ui dfl ' CCD « 
sensor, hr vido9 jl.hl . ui or the like. In Fig. 3, the Sreaira- for 
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directing fluid flow across the exterior surface (o^p^ 
- genorally aa - nozzle 80. The nozzle 80 is located in the space 
0^ shown. as 70 which houses a fiber optic light guide means which 
^ ^shovm in great detail in Figs, 4 through 7. 

Fig. 4 shows yet another embodiment of a laparoscope having 
a nozzle and irrigation channel. Specifically, the distal end 44 
of the laparoscope includes a ^^n3pa ?fihL ' ^1111^^76 which is 
located in the aperture opening 74. In Fig. 4, the nozzle 80 
£ which is located in space 70, directs a fluid flow across the 

exterior surface of the t-ranffpiitront mombsi - 76 and -©eeSwh channel 



4* 

f= > 
It? 

yl 



86 functions as an irrigation orifice. Of course-,, such a nozzle 



is not required to practice this invention, but keeping the 

j« ^r a ncpsarontj i mombei - clear of image impeding material substantially 

iy 

HI improves the quality of the optical image passed by the 

^ endoscope . 
<£- ^ 

The light fibers forming the fiber opti'c light guide 72 are. 
located around the optical image transferring system or member 
and are positioned around the various orifices and nozzles as 
depicted in Fig. 4. 

Fig. 5 illustrates the structure of a distal end of a 
CA^ laparoscope similar to the illuati - atcd ' in Fig. 4 with the 

addition of a third channel 90 which can be ^tis^d ^or other uses 
during surgery, such as for example as an aspiration orifice. 

Fig. 6 illustrates the structure of yet another distal end 
£ of a laparoscope similar to i h u illubLIdLtf d in Fig. 5 with the 
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addition of a fourth channel 92. Channels 86, 90 and 92 are 
6^ equally - cfr a c »- around the optical image transferring system or 
o ptica* imayTi tuanof c ing ' member . As in Fig. 4, the light 
fibers forming the fiber optic light guide 72 are located around 
the optical image transferring system or member and are 
positioned around the various orifices and nozzles. 

Fig. 7 illustrates yet another embodiment of a laparoscope 
wherein the distal end 44 has a different structure than the 
g structures of Fig. 3 through 6. One difference is that the 

*3 ' tianayai - ent mombe* 76 is "Reenter relative to the elonaated 

• 

^ sheath tube 32. As such, the aperture opening 74 is off center 

5^ 

. relative to the elongated axis 102, but is coaxial with the 
=. 

£0 central axis 100 of the ticuispdifcmL m e mber 76. As a result of 

ru 

m the offset of the axis 100 and 102, an expanded space shown 
^ generally as 110 is provided between the rigid elongated sheath 
tube 32 and the optical image transferring member located within 
the laparoscope. A working channel 96 is provided in the 
expanded space 110. The light fibers forming the fiber optic 
light guide 72 are located around the optical image transferring 
member and are positioned around the various orifices, nozzles 
and working channels. 

In each of the structures of the distal ends of endoscopes 
illustrated by Figs. 2 through 7, the fiber optic light guide 72 
directs the light energy out of the distal end and, in each 
embodiment, the light energy retains the non-uniform or 
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unevenness in illumination of the light source, e.g., light 
source 67 as shown in Fig. 2. Of importance, the compensating 
apparatus or video signal compensator are operative with any of 
the optical images developed by the endoscopes illustrated in 
Figs. 1 through 7 to produce a video signal representing an 
optical image having substantially uniform brightness due to 
uneven illumination. 

In the alternative, the fiber optic light guide 72 could be 
eliminated and electrical conductors could be extended through 
the endoscope to the light bulb or light source located at the 



fy distal end. The light bulb or light source could be located in 

e the position shown by working channel 96 in Fig. 7. 

□ 

SB Fig. 8 illustrates a preferred embodiment of a compensating 

ru 

*P apparatus for practicing this invention. An optical image having 
differential picture brightness due to uneven or non-uniform 
illumination (the term "uneven illumination" being use to 
describe this characteristic) developed from an optical 
instrument having a light guide operatively coupled to a light 
source is illustrated by arrow 118. The. optical image having 
differential picture brightness due to uneven illumination 118 is 
imaged directly onto a video sensor 120. The output from the 
video sensor is an analog video signal which is applied to a 
preamplifier 122. 

The video sensor 120 and preamplifier 122 are generally 
located with or operatively attached to the optical instrument as 
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described in connection with Figs, l and 2. In such event, 
electrical conductors 124, which are pperatively connected to the 
preamplifier 122, extend from the proximal end of a laparoscope 
to a remotely disposed video signal processing apparatus depicted 
by dashed box 128. The video signal processing apparatus 128 
includes a video signal compensator or compensating apparatus 
130. 

The video signal compensator or compensating apparatus 130 

□ 

g performs the function of generating a compensating signal which 
M is used to compensate the video signal representing the optical 
»y image having differential picture brightness due to uneven 

* illumination 118. The compensating signal of the video signal 
'ft 

£Q compensator or compensating apparatus 130, shown as output 132, 
Hi 

5J is applied as an input to a standard analog video signal 

* processor 134 which processes video signals to produce an analog 
video in a preselected format, e.g., NTSC, Y/C , RGB or other 
Format . 

When the compensating signal on output 132 is added to the 
input of the video signal processor 134, the output from the 
video signal processor 134, appearing on output 136, is a video 
signal compensated to represent the optical image having 
substantially uniform brightness. The compensated video output 
signal on output 136 is applied to a monitor, video storage 
device, printer or other video device depicted by box 13 8. 
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As shown in Figure 8, the video signal compensator 13 0 is 
located between the preamplifier 122 and the video signal 
processor 134. The advantages of locating the video signal 
compensator 130 in this position is that the video signal is in 
analog format as it is generated by the CCD sensor. The 
preamplifier generally performs the function of providing 
sufficient amplification of the analog video signal to drive the 
electrical conductors with the analog video signal to deliver an 

Q 

g amplified video signal to the remote video signal processor 
UJ 

S3 Another advantage is that the preamplifier video signal and 
=p 

\Q . 

compensating signal can be added at the front end to the video 

m . 

_ signal processor .such that the video signal processor process a 

O 

S3 compensated video signal . 

fU 

CP However, it is also possible to add the compensating signal 

to the video signal after processing of the video signal. For 
example, Fig. 9 illustrates a typical digital video camera. In 
Fig. 9, the optical image having differential picture brightness 
due to uneven illumination 118 is imaged directly onto a video 
sensor 120. The output from the video sensor is an analog video 
signal which is applied to a preamplifier 122 as described above 
relative to Fig. 8. 

The amplified video signal appearing on output 126 is 
applied to an analog-to-digital converter 142, the output of 
which is a digitized video signal representing the optical image 
having differential picture brightness due to uneven 
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illumination. The output of the analog-to-digital converter 142 
is applied to a digital signal processor 146 where the output 
signal is a processed analog video signal representing the 
optical image having differential picture brightness due to 
uneven illumination. The output of the digital signal processor 
146 is applied to a digital-to-analog converter 150, the output 
of which is an analog signal in a standard or preselected format, 
such as an NTSC, Y/C, RGB or other Format video signal. A video 



g signal compensator 154, utilizing the teachings of this 
U 

53 invention, then produces a compensating signal in the preselected 

ir 

jjjj format which is added to and compensates the video signal to 

m 

s represent an optical image having substantially uniform 

o ." . . 

jjg illumination. The compensated output signal appearing on output 

1 156 is applied to a monitor, video storage device, printer or 



^ other video device depicted by box 158. 

The compensating waveform may also be added to the analog or 
digital signal processor. Figs. 10 and 11 discussed below are 
exemplary . 

In Fig. 10, the compensating signal is added to the video 
signal before digital processing of the video signal. For 
example, Fig. 10 illustrates a digital video camera wherein the 
optical image having differential picture brightness due to 
uneven illumination 118 is imaged directly onto a video sensor 
120. The output from the video sensor is an analog video signal 
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which is applied to a preamplifier 122 as described above 

relative to Fig. 8. 

The amplified video signal from the preamplifier 122 is 

applied to an analog- to-digital converter 160, the output of 

which is a compensated analog video signal representing the 

optical image having differential picture brightness due to 

uneven illumination. The output of the video signal compensator 

^ 160 is applied to an analog-to-digital converter 161 wherein the 

y digital signal is applied to a digital signal processor 162. The 
83 

£ output of the digital signal processor 162 is a digitized 

ru 

m 



compensated video signal which is applied to a digital-to-analog 



lj converter 163 wherein the output signal from the digital -to- 
SO 

py analog converter 163 is a processed analog video signal 

m > 

*g representing the optical image having differential picture 
brightness due to uneven illumination. The output of the 
digital-to-analog converter 163 is applied to a monitor, video 
storage device, printer or other video device depicted by box 
164. 

Fig. 11 illustrates another embodiment of a typical analog 
video camera having a video signal compensator located after the 
analog video signal processor. In Fig. 11, the optical image 118 
having differential picture brightness due to uneven illumination 
118 is imaged directly onto a video sensor 120. The output from 
the video sensor 120 is an analog video signal which is applied 
to a preamplifier 122 as described above relative to Fig. 8. 
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The amplified video signal from the preamplifier 122 is 
applied to an analog video signal, processor 165. The output from 
the analog video signal processor 165 is applied to a video 
signal compensator 166 where the output signal is a processed 
analog video signal representing the optical image having 
differential picture brightness due to uneven illumination. The 
output of the video signal compensator 166 is in a standard or 
preselected format, such as an NTSC, Y/C, RGB or other Format 

Q 

^ video signal. The video signal compensator 166, utilizing the 

03 

^ teachings of this invention, produces a compensating signal in 
fy the preselected format which is added to and compensates the 
=^ video signal to represent an optical image having substantially 
^ uniform illumination. The compensated output signal from the 
*~ video signal compensator 166 is applied to a monitor, video 



storage device, printer or other video device depicted by box 
168. It is envisioned that the video signal compensator could be 
used at numerous locations in the video signal circuit path, or 
even in the digital signal processor. 

Figure 12 (a) is a graph of the video signal depicted by 
waveform 162 representing the optical image having differential 
picture brightness due to uneven illumination. The reference 
line for brightness is shown as 170. The portion shown as 172 of 
the waveform 170 represents that part of the optical image 118 
which is less bright than a reference 170 and the portion shown 
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as 174 shows that part of the optical image which, at its peak, 
is brighter than the reference 170. 

Figure 12 (b) is a graph of the compensated video signal 
depicted by waveform 178 representing the optical image after the 
gain of the video signal has been compensated by the compensating 
signal generated by the video signal compensator 130 of Fig. 8. 
The reference line for brightness is shown as 170. The portion 
shown as 180 of the waveform 178 represents that part of the 
optical image 118 which was less bright than a reference 170 

K 

^ output video signal and its gain both vertically and horizontally 

P 

ry was compensated by increasing the gain of the video signal 

m 

* representing that part of the optical image which was less bright 
□ 

^ than the reference 170. 

iU 
01 

^ With respect to the portion of the compensated video signal 

shown as 182 which was brighter than the reference 170, its gain 
was compensated both horizontally and vertically by reducing the 
gain of the video signal compensating the video signal to 
represent an image having a substantially uniform brightness. 

Fig. 13(a) pictorially represent an optical image wherein 
the differential picture brightness of an optical image is 
brighter at its center 188 than at its periphery 190. The solid 
portion of lines 192 depict a decreasing brightness of the 
optical image while the dashed portions of line 192 depict the 
less brightness as the brightness of the optical image drops of 
to the periphery 192 which is less bright. 
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Fig. 13(b) pictorially represent an optical image wherein 
the differential picture brightness of an optical image is 
brighter at its periphery 196 than at its center 188. The solid 
portion of lines 200 depict a decreasing brightness of the 
optical image while the dashed portions of line 200 depict the 
less brightness as the brightness of the optical image is less 
bright at the center 198. 

Fig. 14 is a pictorial representation of a line 204 
representing the top portion of an envelope of a compensated 
video signal plotting the intensity as a function of distance W S" 
from the axis of the image 206. As shown by the line 204, the 
compensated video signal is amplified by a controlled device such 
as a controlled gain amplifier or variable gain amplifier to 
increase the brightness of the output video signal to a level 
which is greater than the average of the differential brightness 
of the optical image due to the uneven illumination. 

Before describing the operation of the schematic diagram of 
Fig. 16 which is of the embodiment of the video signal 
compensator 134 illustrated in Fig. 8, the following discussion, 
relates to the form of the basic waveforms that are used in the 
video signal compensator for compensating differential picture 
brightness of an optical image due to uneven illumination. 

The video signal compensator comprises a device for 
generating a compensating signal substantially representing at 
least one parameter of a compensating waveform required for the 
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differential picture brightness of an optical image to produce a 
video signal representing an optical . image having a substantially 
uniform brightness. In the schematic diagram of Fig. 16, the 
video signal compensator is an analog signal generating device. 

The video signal compensator includes a sawtooth wave 
generator for generating a sawtooth waveform having a 
predetermined rising slope and a sawtooth wave generator for 
generating a sawtooth waveform having a predetermined falling 
slope . 

Fig. 15(a) is a sawtooth waveform 210 having a predetermined 
rising slope and a controlled amplitude. Fig. 15(b) is a 
sawtooth waveform 212 having a predetermined falling slope and a 
controlled amplitude. 

The video signal compensator also includes a parabolic wave 
generator for generating a parabolic waveform having a controlled 
amplitude and orientation. 

Fig. 15 (c) is a parabolic waveform 214 having a controlled 
amplitude and orientation. If the orientation of the parabolic 
waveform is reversed, it is referred to as an "inverted parabolic 
waveform. " 

The amplitude and slope of the sawtooth waveform and the 
amplitude and the orientation of the parabolic waveform are 
adjusted as required to generate an acceptable compensating 
signal. In operation, an analog signal adder operatively coupled 
to the sawtooth wave generator and the parabolic wave generator 
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adds the sawtooth waveforms and the parabolic waveform to produce 
a compensating signal. The compensating signal is used to 
compensate the video signal representing the optical image having 
differential picture brightness due to uneven illumination. 

Referring now to the schematic diagram of Fig. 16, the 
circuit is based on the use of two (2) quad operating amplifiers. 
In operation, the horizontal synchronizing signals of the 
composite video signal are applied to lead 220 and inverted by 

□ 

\S amplifier 224. If the horizontal synchronizing signals of the 
U 

S3 composite video signal are of proper polarity, then inversion of ■ 
h 

the signals will not be necessary. The output of amplifier 224 
s is applied as an input to amplifier 226 which is used as the 

q 

55 sawtooth wave generator to generate a sawtooth waveform in the 

ru 

ffj_ form of sawtooth waveform 210 of Fig. 15{a) having a 

predetermined rising slope and a controlled amplitude. The 
output of the sawtooth wave generator 226 applies the sawtooth 
waveform to lead 230 which forms one side of a sawtooth waveform 
balance network 236. The output of the balance network 236 is 
adjusted as required to produce an acceptable balance using the 
sawtooth waveform by the variable pot, variable resistor or 
potentiometer depicted as balance network 136. The output from 
balance network 136 appears on lead 252. 

In addition, the output of the sawtooth wave generator 226 
applies the sawtooth waveform to lead 240 which is an input to 
amplifier 244. Amplifier 244, which essentially functions as a 
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sawtooth wave inverter, inverts the sawtooth waveform having a 
predetermined rising slope and. a controlled amplitude to generate 
a sawtooth waveform having a predetermined falling slope and 
controlled amplitude in the form of sawtooth waveform 212 of Fig. 
15(b). The output of the amplifier 244, applies the sawtooth 
waveform to lead 250 which forms the other side of a sawtooth 
waveform balance network 236. 

The output of the amplifier 244 is applied to input 254 of 

□ 

g an amplifier 256 which functions as a parabolic wave generator. 
| Amplifier 256, produces as an output a parabolic waveform having 
a controlled amplitude and orientation in the form of parabolic 
waveform 214 of Fig. 15(c) having a controlled amplitude and 
| orientation. In the preferred embodiment, the parabolic waveform 
is an inverted parabolic waveform. 

Lead 252, which is the output of the balance network 13 6 is 
operatively connected to a summation terminal 260 which is an 
analog adder. The balance or mix of the sawtooth waveforms 
received by inputs 230 and 250, respectively, are controlled by 
the adjustment of the balance network 236. In addition, the 
output of the amplifier 256, which functions as a parabolic 
waveform generator, applies the parabolic waveform having a 
controlled amplitude and orientation to the summation terminal 
260, to produce the horizontal component of the compensating 
signal . 
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The vertical portion of the compensating signal is generated 
as follows. The vertical synchronizing signals of the composite 
video signal is applied to lead 270 and inverted by amplifier 
272. If the vertical synchronizing signals of the composite 
video signal are of proper polarity, then inversion of the 
signals will not be necessary. The output of Amplifier 272 is an 
input to amplifier 274 which issued as the sawtooth wave 
generator to generate a sawtooth waveform in the form of sawtooth 
waveform 210 of Fig. 15{a). The output of the sawtooth wave 
generator 274 applies the sawtooth waveform to lead 280 which 
forms one side of a sawtooth waveform balance network 286. The 
output of the balance network 302 is similarly adjusted by the 



Q 

0j variable pot, variable resistor or potentiometer depicted as 



ry 



balance network 286 and the output appears on lead 302. 

In addition, the output of the sawtooth wave generator 274 
applies the sawtooth waveform to lead input 2 90 of an amplifier 
294. Amplifier 294, which essentially functions as a sawtooth 
wave inverter, inverts the sawtooth waveform having a 
predetermined rising slope and a controlled amplitude to generate 
a sawtooth waveform having of Fig. 15(b) . The output of the 
amplifier 294, which also functions as a sawtooth wave inverter, 
applies the sawtooth waveform to lead 300 which forms the other 
side of a sawtooth waveform balance network 286. 

The output of the amplifier 294 is applied to input 304 of 
an amplifier 306 which functions as a parabolic wave generator. 
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Amplifier 306, produces as an output a parabolic waveform having 
a controlled amplitude and orientation in the form of parabolic 
waveform 214 of Fig. 15(c). In the preferred embodiment, the 
parabolic waveform is an "inverted parabolic waveform." 

Lead 302 of the output of the balance network 286 is 
operatively connected to a summation terminal 310 which is an 
analog adder. The balance or mix of the sawtooth waveform 
received by inputs 280 and 300, respectively, are controlled by 
£ the adjustment of the balance network 286. In addition, the 

K l output of the amplifier 306, which functions as a parabolic 
S 

pj waveform generator, applies the parabolic waveform having a 
controlled amplitude and orientation to the summation terminal 
310, or analog adder, to produce the vertical component of*' the 
^ compensating signal. ^ 

The horizontal portion of the compensating signal appearing 
on the summation terminal 260 and the vertical portion of the 
compensating signal appearing on the summation terminal 260 are 
applied to summation terminal 316 which produces the compensating 
signal required to compensate the video signal to represent the 
optical image having substantially uniform brightness. The 
compensating signal appearing on summation terminal 316 is 
applied as an input to controlled gain amplifier 330 which 
amplifies the compensating signal to the desire level. 

Amplifier 340 is unused. The output of the controlled gain 
amplifier 330 has a high impedance relative to the video signal 
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to be compensated in the video signal processor, illustrated as 
134 in Fig. 8. Therefore, the output of the amplifier 330 is 
applied to input 332 of a video driver 334 which produces a 
compensating signal on output 336 at a low impedance. Output 336 
is then applied to the preamplifier stage of the video signal 
processor 134 of Fig. 8 as is well known to a person skilled in 
the art. An adder in the video signal processor 134 is used to 
add the compensating signal and video signal to produce the 

□ 

compensated video signal. 

U 

J Based on the above • description, it is readily apparent that 

yp 

py the video signal compensator is a device for generating a 

m 

s compensating signal substantially representing at least one 

S 

yj parameter of a compensating waveform required for the 

m 

ffj differential picture brightness of an optical image to produce a 
compensating signal. For example, the parabolic waveform would 
be used alone if one of a sawtooth wave generator and a parabolic 
wave generator was used to practice the teachings of this 
invention, a compensating signal would be generated which 
compensates the video signal to represent at least an improved 
optical image having substantially uniform brightness. In the 
preferred embodiment, both the sawtooth waveforms and the 
parabolic waveform are used produce the compensating signal used 
to compensate an uncompensated analog video signal to represent 
an optical image having substantially uniform brightness. 



-44- 



□ 

Ul 

55 

m 
m 

□ 

m 
ru 
m 



255 012797 7256 613100/1580 

As described above, the compensating signal is added to the 
video signal at the input of a, video .signal processor 134 to 
produce a compensating video signal. The video signal ■ process is 
responsive to the compensating signal by adjusting the gain both 
vertically and horizontally by increasing the gain of the video 
signal representing that part of the optical image which is less 
bright than a reference and reducing the gain of the video signal 
representing that part of the optical image which is brighter 
than a reference compensating the video signal to represent an 
image having a substantially uniform brightness. 

In the preferred embodiment, the differential picture 
brightness is brighter at. its center than at its periphery. The 
video signal compensator adder adds the sawtooth waveform, the 
parabolic waveform and the video signal to produce a compensating 
signal which is applied as an input to a video signal processor 
adjusting its gain both vertically and horizontally. This is 
accomplished by increasing the gain of the video signal in 
response the sawtooth waveform representing the periphery of the 
optical image and by reducing the gain of the video signal in 
response to the parabolic waveform representing the center of the 
optical image resulting in the video signal representing an 
optical image having a substantially flat brightness. 

In the event that the differential picture brightness of an 
optical image is brighter at its periphery than at its center. 
The adder adds the sawtooth waveform, the parabolic waveform and 
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the video signal to produce a compensating signal which is 
applied as an input to a video -signal processor together with a 
compensating signal producing a compensated video signal. The 
compensated video signal is used to adjust the gain of the video 
signal processor both vertically and horizontally. This is 
accomplished by decreasing the gain of the video signal in 
response the sawtooth waveform representing the periphery of the 
optical image and by increasing the gain of the video signal in 
response to the parabolic waveform representing the center of the 
optical image resulting in said video signal representing an 



fy optical image having a substantially flat brightness. 

m 

b Figures 1 through 16 disclose the elements or components of 

jS a preferred embodiment of a system for practicing this invention. 

it? 

^ The system includes an endoscope 30 having a proximal end 38 and 

*0 

a distal end 36. A light guide 72 is located within the 
endoscope and extends from the proximal end 38 to the distal end 
36 of the endoscope 30. The light guide 72 has a light post 52 
at its proximal end which is adapted to receive light energy from 
a light source 67 and to transmit the light energy from its 
distal end to illuminate an operative site. 

In the alternative, the light guide 72 could be eliminated 
and an illumination source such as a light bulb could be located 
directly at the distal end 36 of the endoscope 30. 

The endoscope includes an optical image transferring member, 
included as part of element 76, which extends from the proximal 
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end 38 to the distal end 36 of the endoscope. A light source 67 
is operatively connected to the light post 52 to apply light 
energy to the light guide 72. A video sensor 68 is operatively 
coupled to the proximal end of the endoscope 30 for imaging an 
optical image having differential picture brightness due to 
uneven illumination. 

A compensating apparatus is operatively coupled to the video 
sensor and includes a sawtooth wave generator for generating a 
sawtooth waveform having a predetermined rising slope, a 
predetermined falling slope and a controlled amplitude. In 
addition, the compensating apparatus includes a parabola wave 
generator for generating a parabola waveform having a controlled 
amplitude and orientation. An adder is operatively coupled to 
the sawtooth wave generator, the parabolic wave generator and a 
video signal for adding the sawtooth waveform and the parabolic 
waveform to produce a compensating signal which is used as an 
input to a video signal processor adjusting its gain both 
vertically and horizontally. This is accomplished by increasing 
the gain of the video signal representing that part of the 
optical image which is less bright than a reference and reducing 
the gain of the video signal representing that part of the 
optical image which is brighter than a reference compensating the 
video signal to represent an image having a substantially uniform 
brightness . 
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Also, the preferred embodiment of the endoscope includes a 
light guide 72 which is a fiber optic light guide and the 
laparoscope having a fiber optic light guide independent of the 
distal end of the endoscope produces and optical image having a 
differential picture brightness which is brighter at its center 
than at its edges. 

In the embodiment of Fig. 17, an optical image having 
differential picture brightness due to uneven illumination 398 is 

□ 

\D imaged directly onto a CCD sensor 400. The output from the video 
W 

^ sensor 400 is an analog video signal which is applied to a 

4» 

*0 

fy preamplifier 402. The preamplified video signal is applied to an 

5 

e analog-to-digital converter 406. The video signal compensator in, 
□ 

C9 this embodiment is a part of a digital signal processing device 

ru 

8] shown by dashed lines 410. 

^ The digital signal processing device 410 includes a digital 

storage device or freeze frame 414 for storing a digital 
representation of the video signal having the differential 
brightness due to uneven illumination received from the analog- 
to-digital converter 406. Concurrently, the digital video signal 
from the analog-to-digital converter 406 is applied to a digital 
signal processor 416 for digitally processing the digital 
representation of the video signal. The digital processor 416 
produces a digital compensating signal representing at least one 
parameter of a compensating waveform required for the 
differential picture brightness of an optical image to produce a 
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video signal representing an optical image having a substantially 
uniform brightness. The digital processor 416 digitally 
calculates the components of the compensating signal using a 
sawtooth waveform reference and a parabolic waveform reference in 
a process analogous to that of the analog process described above 
for the analog processing, except however, the calculation is 
performed digitally. The output form the digital signal 
processor 416 is a compensating signal in analog format having an 

P 

j9 illumination signal Y Q and color signal C Q . Illuminates signal Y Q 

appears on lead 424 and color signal C 0 to appears on lead 426. 
py The video signal is stored in the digital storage device 414 

m 

s for a predetermined period of time and is applied to a digital - 
Q 

W to-analog converter 420. The output from the digital-to-analog 
converter 420 is the analog video signal representing the output 

^ image 390 delay by a predetermined time period. The output from 
the digital -to-analog converter 420 appears on output 430. 

The illumination signal Y G on lead 424 is applied as an 
input to first adder 434. The color signal C 0 on lead 426 is 
applied as an input to a second adder 438. The delayed 
uncompensated analog video signal on output 430 is applied to 
each of the first inputs of the adders 434 and second adder 438. 

The analog output from the first adder 434 is in the form of 
a compensated illumination signal Y m which appears on output lead 
440. The analog output from the second adder 438 is in the form 
of a compensated color signal C m which appears on output lead 
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442. The output video signal represents the optical image having 
substantially uniform brightness and is applied to a device shown 
by 138 in Fig. 8. 

In the embodiment of Fig. 18, the initial components are the 
same as described in Fig. 17 and include the optical image having 
differential picture brightness due to uneven illumination 398 
being imaged directly onto a CCD sensor 400. The output from the 
video sensor 400 is an analog video signal which is applied to a 

Q 

*Q preamplifier 402. The preamplified video signal is applied to an 
^ analog-to-digital converter 406. The video signal compensator in 
this embodiment is a part of a digital signal processing device 
shown by dashed lines 410. 

At this point, the embodiment of Fig. 18 differs from that 
of Fig. 17. In the embodiment of Fig. 18, the digital signal 
processing device 410 includes a digital storage device or freeze 
frame 414 for storing a digital representation of the video 
signal having the differential brightness due to uneven 
illumination received from the analog-to-digital converter 406. 
Concurrently, the digital video signal from the analog-to-digital 
converter 406 is applied to a programmable digital processor 
shown by dashed box 410' for digitally processing a digital 
representation of the video signal representing the differential 
picture brightness of the optical image due to uneven 
illumination. The digital signal processor 410' produces a 
digital compensating signal representing at least one parameter 
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of a compensating waveform required for the differential picture 
brightness of an optical image to produce a video signal 
representing an optical image having a substantially uniform 
brightness . In this embodiment the programmable digital 
processor 410' includes an 8 x 8 pixel matrix 
multiplexer/processor 450. 

The video signal is stored in the digital storage device 414 
for a predetermined period of time to enable the 8X8 pixel 
matrix multiplexer/processor 450 to digitally calculate the 
components of the compensating signal using a sawtooth waveform 
reference and a parabolic waveform reference in a process 
analogous to that of the analog process described above for the 
analog processing, except however, the calculation is performed 
digitally. The 8x8 pixel matrix multiplexer/processor 450 
analyzes the brightness level of the optical image represented by 
the video signal on a bit-by-bit bases against a brightness 
reference to determine the required compensating signal for the 
horizontal and vertical components thereof. The output of the 8 
x 8 pixel matrix multiplexer/processor is a digital signal. 

The output from the digital storage device 414 is applied to 
the 8x8 pixel matrix multiplexer/processor 450 where the 
digital video signal is compensated with the compensating signal 
generated by the 8X8 pixel matrix multiplexer/processor 450. 
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The output from the 8x8 pixel matrix multiplexer/processor 
450 is applied to the digital signal processor 416 which produces 
a compensated analog video signal representing the differential 
picture brightness substantially uniform brightness. The digital 
techniques for performing this analysis are well known to persons 
skilled in the art. 

In the embodiment illustrated in Fig. 18, the analog output 
from the digital signal processor 416 is in the form of a 

□ 

compensated illumination signal Y m which appears on output lead 

09 

g 452 and a color signal C m which appears on output lead 454. 

s 

fti In smaller diameter endoscopes having a diameter at the 

distal end in the order of about 5 mm or less, the video signal 
representing the optical image typically has a waveform 460 
illustrated by Fig. 19. In Fig. 19, the waveform 460 has a low 
level noise portion of the video signal shown as element 462 
which appears before the video information signal portion 464 of 
the video signal and a low level noise portion of the video 
signal shown as element 466 which appears after the video signal 
portion 464 representing the picture information. This low level 
noise portion of the video signal 4 60 can be monitored by a 
sensing device for sensing and removing the noise to improve the 
video signal. 

Fig. 20 illustrates a waveform 470 of the video signal from 
a small diameter endoscope illustrating the effects of the 
sensing device for sensing and removing the noise before and 
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after the video signal. In Fig. 20, the portion of the signal 
shown as 472 before the information portion of the signal 474 has 
the noise removed therefrom. The picture portion of the* video 
signal 474 is substantially the same as the information signal 
portion 464 of Fig. 19. Also, in Fig. 20, the portion of the 
signal shown as 476 after the information portion of the signal 
474 has the noise removed therefrom. In this manner, the picture 
information represented by the portion of the signal 474 
£1 represents the definitive picture signal. 

^ In the preferred embodiment, the sensing device for sensing 

«j and removing the noise is in the form of a blanking circuit 4 80 
& 

s as illustrated by Fig. 21. The signal appearing on input 482 to 
f~ 

S3 the blanking circuit 480 is essentially in the form of the 

m 

J waveform 460 shown in Fig. 19. The signal appearing on the 

output 484 of the blanking circuit is essentially in the form of 
the waveform 470 shown in Fig. 19. One example of a sensing 
device that can be used in such a blanking circuit is a Schmidt 
trigger which require that a certain threshold voltage level be 
reached by the video signal before the amplifier receives the 
input video signal. Of course, any known electrical system or 
circuit for sensing and removing the noise is envisioned to be 
within the teachings of this invention. 

The present invention includes a method for compensating for 
differential picture brightness of an optical image due to uneven 
illumination. The method comprises the steps of: (a) generating 



-53- 



255 012797 7256 613100/1580 

with a compensating signal generating device a compensating 
signal substantially representing at least one parameter of a 
compensating waveform required for the differential picture 
brightness of an optical image to produce a video signal 
representing an optical image having a substantially uniform 
brightness; and (b) adding with an adder operatively coupled to 
the compensating signal generating device and a video signal the 
compensating video signal and the video signal to produce a 

□ 

g compensating signal which is used as an input to a video signal 

W 

S3 processor to adjust its gain both vertically and horizontally by 
jfi increasing the gain of the video signal representing that part of 
the optical image which is less bright than a reference and 

b 

jq reducing the gain of the video signal representing that part of 

ru 

g\ the optical image which is brighter than a reference compensating 
*D said video signal to represent an optical image having a 
substantially uniform brightness. 

In an application where the differential picture brightness 
of an optical image is brighter at its center than at its edges, 
the method step of adding produces as an output signal a video 
signal having its gain both vertically and horizontally 
compensated by increasing the gain of the video signal in 
response the sawtooth waveform representing the edges of the 
optical image and reducing the gain of the video signal in 
response to the parabolic waveform representing the center of the 
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optical image compensating said video signal to represent an 
optical image having a substantially flat brightness. 

In an application where the differential picture brightness 
of an optical image is brighter at its edges than at its center, 
the method step of adding produces as an output signal a video 
signal having its gain both vertically and horizontally 
compensated by decreasing the gain of the video signal in 
response the sawtooth waveform representing the edges of the 

S 

U optlcal im age and increasing the gain of the video signal in 

^ response to the parabolic waveform representing the edges of the 

i i 

nj optical image resulting in said video signal representing an 
optical image having a substantially flat brightness. 

Where the method is an analog process, the step of adding 
includes a compensating signal generating device which is an 
analog signal generating device for generating the compensating 
signal. Similarly, where the method is a digital process, the 
step of adding includes a compensating signal generating device 
which is an digital signal processing device for generating the 
compensating signal. 

If it is desired to raise the brightness level of the 
compensated video signal, the method further includes the step 
of: (a) increasing with a control device operatively coupled to 
the adder the brightness of the output video signal to a level 
which is greater than the average of the differential brightness 
of the optical image due to the uneven illumination. For 
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impedance matching, the method further includes the step of: (a) 
applying, with a driver amplifier operatively coupled to the 
adder, the output video signal to a video signal processor at a 
low impedance. 

In the preferred embodiment, the method includes the use of 
a compensating signal generating device which is an analog signal 
generating device for generating the compensating signal. The 
method further comprises the steps of: (a) generating with a 
jQ sawtooth wave generator a sawtooth waveform having a 
> predetermined rising slope, a predetermined falling slope and a 

s 

pj controlled amplitude, (b) generating with a parabola wave 

m 

b generator a parabola waveform having a controlled amplitude and- 
orientation; and (c) adding with an analog signal adder the 
sawtooth waveform, the parabolic waveform and the video signal to 
produce the compensating signal . 

Although the preferred embodiment of the present invention 
is used in a medical laparoscope having a fiber optic light 
guide, the video signal compensator can be used with any optical 
system where a light source having a non-uniform or uneven 
characteristics is used to illuminate an operative site or 
inspection area providing an optical image having differentiated 
picture brightness due to the uneven illumination. The light 
source may be located intermediate the endoscope or at the distal 
end of the endoscope. 
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It is also envisioned that the teachings of the present 
invention can be used for industrial applications. For example, 
borescopes are used to inside the inspect the interior stages of 
jet engines. Typically, the optical image produced by a 
borescope is imaged directly on a video camera. The video signal 
compensator disclosed and taught herein can be used for such 
industrial applications. Further, person skilled on the art can 
identify other applications where the uneven brightness of an 
^ optical image can be compensated to produce a substantially 
jp uniform brightness level. It is envisioned that this invention 
can be used for such applications. 
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